1/64 



#3 

I 

Diagnostic support 
execution terminal 



Diagnostic 
information 



Medical system 
#5 



#4 



I Network \ 
I (WAN/LAN) J 



FIG.1 



1 

Diagnostic support 
content server 



#1 



#2 



Network 
#4^ 



#8 



#10 

_2_ 



Input/output 
control means 



Distribution 
destination 
management 
file storage 
means 



#9 



Diagnostic support content server 



Control means 



Main program 
storage means 



#6 



Diagnostic 
support content 
storage means 



41 



FIG. 2 



2/64 



O 

I 



o 



o 

o 
"c 

e 




CD 

9 

E 



CO 

O 



^§ o 

J. . — - I — f— 



o 

I 



o 




opi 


£ 


o 




to 




Endo 


CO 



7 

4 



3/64 



#10 

_L_ 

Input/ 
output 
control 
means 



#32 

I 

Diagnostic support content 
distribution executing section 



#33 

I 

Storage means 
management section 



Main program 

—? 

31 



Distribution 
destination 
management file 
storage means 

~~~P ~ 

#8 



Diagnostic 
support content 
storage means 

~~~? " 
#6 



FIG.4 



#41 
#43 
#45 
#47 



Input/output control means l/F 



Diagnostic support content updating/ 
addition detecting section 



Diagnostic support execution 
terminal authenticating section 



Diagnostic support content 
list creating section 



Diagnostic support content 
designating section 



Diagnostic support content 
management means 



Diagnostic support content 
selecting section 



-#32 
'#42 

#44 

#46 



FIG. 5 



4/64 



Q Start ^ 



SI 



Detect updating/addition of 
diagnostic support content 



,S2 



Acquire distributed diagnostic 
support content 



,S3 



Specify distribution destination 
terminal 



Is distribution" 
destination terminal 
authenticated ? 

[yes 



S5 



Distribute diagnostic support 
content 



xS6 

Is content ^ 
distributed to all distribution 
destination terminals 



FIG. 6 



5/64 



On! / 

LO 

44= 



o sr Guo 
u 13 5 o 

3" 



CO 



S o g g - 

g"£ ^ o 

3 o JS a> 

=T </> O g "> 



as 

fl 

Q- c 

- 8 



LO 

44= 



01) CD 

<d c: co 



■e ■£ 

o o 

Q. <D 
Q. <>0 

Z3 _ 

co O O 
O O F= 

E 
o 
o 



3 



CO ^ 
LO 

44= 



cr 
o 

"13^ 
E — 

.o o 

-I—' '* > ^. 

g E. 

Q 



LO 

44=" 



V V 









o 




cr 


Q. 
Q. 




o 
"-*-» 


=3 


o 


o 

CD 


CO 






"13 


CO 


O 
*-*-» 

CO 

O 


form 


00 
cz 






13 


9 




CD 






o 


o 





LO 

44= 



E 



A e g\ 

1 IB "2=< <D 
iis to 43 rz 



.p S E 
E-g E a> 



co 



vz 



CD 5 

° S3? 



CZ 

cd 

CD 



o 
o 

Q. 

CO 

Q 



44= 



^ .ill 



c E-8 — 




6/64 



C start ) 



Acquire and tr 
specifying infor 


ansmit terminal 
mation 




A 


Receive diagnostic support content 






Update diagnostic support content 
management information 


> 




Store diagnostic support content 



S11 



S12 



,S13 



S14 



1 r 



FIG. 8 



7/64 



5" 



^ 

LO 

> LO 

LO i— 

o 

^ ■ r 

E £ 2 
sT o 

o z O 



LO O 
CO 

. . CD 

3= o 



53 ._ 

M C 
O 

° £5 

O CD 

CL OS 
<S> _Q 
13 o 
oo o 

~ o.S2 

2? t5 

CD CD CD 
I — "O 



c 
o 

"8 



3 



LO CO 
CO 

LO LO 



CO 

00 



CO ^ 

"oo 



-Q 



co Q. 
Q. Z3 
Z3 O 

DO 

co 
o cvJ 



CO 

2 o ^ 
ctf <y> oo 

>> 



■is <?:>o 

~ TD ±t 

C co O 
U C CD 
O <L> Q. 
□O CO CO 



O 



CD 



v. 5 

CD _ 

o cz 
o o 

zn cd 

CO 

v- cd 

O _Q 

as 

CO 



co 



-4=; .o 

co 4^ 

S 8 




8/64 



o 



CD ~ 

-4-" CJ 



o 
c: 



i 

o 
o 

CO 

8 



12 O 



E 
o 

S3 

o 
o 

Is 

15 ° 
E >, 

°1i 

Z CD 



CO 

<d 



.Q o 



o 



TO 

o 
"go 

J 



CD 
O 



o 



OS 
CD 



-a 

CD 



cr 

CD 



2? 

Q. 
O 

CO 



CO -£j 

O CD 



o 



o 

"-4— » 
CO 

CD 

la, 

51 



O 
CO 



CO 



LO 
LO 



Q. <» 
=3 _^ 
O £ 

CD 

9 

>r CD 



(20 

~cd 



CO 



o. 

O 
v- 
00 

E a> 

£ > 

o 
o 



CD 

9 



51 

<£ cd 



CO 



CD 



Q. 
O 

« CD 

I" 8 

Si 

uj <S 



< 



CO 

< 



A21 



Refer to typical and 
similar case images 



A22 




9/64 



Switch between typical 
and similar cases 



A25 



Similar case 



Ha type early 
cancer No. 12 



V^A28 




Characteristic value Target Target 

IHb value : 67.5 68.9 

G variation coefficient :0.64 0.71 

Blood vessel area ratio : 0.44 0.67 



Before 



Next 



A26 



Details 

7 
A27 



-A29 



A30 



FIG.11 













Ha type early cance 
Typical case No. 12 
Sex:M 
Age : 66 

Region : body of stomach, curvature ventriculi 
Peripheral mucous membrane : atrophy+ 
Size: 13mmX16mm 
Boundary region : asymmetry 




Detailed display window 


Close 



FIG. 12 



10/64 



CO 

5 



CVJ 

3 



CD 
Q. 

H 

CD 
CD 



CD 
5 



CD 
O 



O 

CD 
CD 

-I— • 



-t—> ccJ 

■g E 

CO 

8 o 

fl 
tl 

GO O 



Sf CO 

o 

CD O 
"O 

<*$ CD 



op 



5 8 

JQ 2 
ZJZ CD 



CD 



— -Q .-ti 
CD 



CD 



S= -g E o 
O O CO oo o 



CO ^ 

CD 

CD 
CO 



CD 



CO 

5 



CD 
O 

E 
o 

CD 
_=3 

> 

"fo 

O CO 
v2 CO 

^1 

-I » CO 

4*1 

co CD 
DO • • 
.C CD 

c o 

CD -Q 

op o 



o 
"o 

CO 

si 

o 



CO 

o 



CD 



O 



CD 
O 



CD j^, 

is 

Q--0 

Z3 CD 
Q0"p 

2 O 
J= GO 



CD 
CO 
C CO 

v- CD 
CD > 

a 3 



CM 

o 
cz 

CD 

CZ 
co O 

CO 

O — 

CO 



'3 



11/64 



LO 

LO 



CO 

3 



CD 



CD 
CD 

1 



a> 
o 



as 
o 



CD 




■8 



CO 
CD 



i ; 

o o 

CD 

CD 13 

-£ CD 
O .Q 
O 

cz 
as 
o 



CD 

E 



CD LU 



if 

-4 — ' 

CD 

« ON 

=6^ o 



"8 




12/64 



CO 

3 



-S3 

E c 
o 2 

!*£ 

CD <^ -r^ 
co 

S3 | 



O 
"id 



6 P 

c OJ 

I-ii 

- M o 

cd co -jz; 

o CO 



o 

Cd -+-» 

cd c 



CD 

o> 



Z3 
O 



cd 



cd cd 



g o o o5 
o — 

c cd : X3 cd 
— <-> co 

CD -f^ 2 — 
W W C D 

cd op o 
g> _JS .2 "cd 
oo O O 



c 

E ^ 
1« E 
2? o 



LU O 



CO 
CO 

< 



o 



CD 

CD 
co 

T3 



S r- C 



.O cd 



cd 

E 



^ b2 «J 
E ^= <d 

o-o 

CZ Cd CD 
^ W-H 

CD 52 
co £= =j 

g> .2 "cd 

L — J - 



a? o 

I * 

X ^ 
LU O 



cd 

Id 
"O 

d 
o 

CD 
O 



LO 



LO 



CD 

8 § 

Q- £ CD 

CO _c q cd 

co .== C C. 

O >\ CD CD 

v, ClJ S § 

« Q.OO 
□ w ■ 



13 

g § I 

OjO ° CD 
CD CD ^ 
*— oo — " 

.ill 



CL. ^ 
C 

g ° 

O CD 

§ S S 
-p-'-cd-E 

£ o o 
_c izn cd 

cd "i^ 
^ S g 

cud o 



o X ccj o O jd 



CD 

O CD 
"-£3 -4- 
CO 

*d CZ 
CD .O Q_ 

^ Id o 
cd o _ 
O o 



J==fc 



o 

is 

o 
*co 

cd 

Si? 

CD O «— 
"O <D 



13/64 



Start 





^S21 


Set diagnostic support content 






^S22 


Acquire patient/examination 
information 










^S23 


Acquire image information 






^S24 


Create diagnostic support 
information 






^S25 


Display diagnostic support 
information 




^^^^ NO 
End? ^>^~ 

JYES 



( jj ) 



FIG. 16 



14/64 




15/64 




16/64 



CSi 



CD 



OS 



S fc 



O 
O 

-£ 

o 

Q. 
Q. 

CO 



CO 

o 

I 



o 

I 

o 
o 

I 

O 



GO 

'15 



4* 

_2_ 




2 8 

o 

Q. CD 



CNJ 

S t t t 



.-V 



o 



o 



o 
o 

e 

o 

CD 



E 
o> 

CO 
CD 

CD 

E 




o 




CO 






Con 


me; 



A ^2 

=tt= 



CO 
■4— » r— 

_f E 

2? ^ P 
o c c= 



o <^ 



CO 



SI 

Q. 

CO 

Q 



.2 c § 
E -£ E o> 

«1 



as 

£ 

o ! 

Q. i 



3 



co , 



CD 



CL 
CO 

Q 

T~ 

oo 



If II 

CD -— 



BlS 



-5 
2 



T 



44= 



o 




opi 


E 


o 


CD 


CO 




Endo 


CO 



17/64 



CvJ 

=«= 



OS 

c: 

<5 ^ 



o c oo 

-2 «- 
o (5 5 o 

43 e r-s 



o c 92 



o ^ w 



44= 




2? §- o a> 
-jf co o £ 2> 



-4-T p 

=5 _H 

^ o 
o 



LO 



CO 
CSJ 

44= 

J- 



CD 

d) Ofl a 

C co 







a 






o 


o 






Q. 




CD 


Q. 




CO 


Z3 
CO 


d 


a 


O 


CD 


o 


"c 




CO 


O 


o 


agno 


O 


muni 






com 



CO 

cvj, 



.o o 



Q. .2 

Q. CZ -4-* 

^.Q o 

40 -a s 

c c 

5 b 



oo 

CVJ' 



- CSJ 

44= 



LO 

44=' 



2 

GkJO 
O 



A* 



CO 
4+: 



o5 
O 

c o 

CD 



a> 



44= 

_2_ 



CD 

-4—* C2 

co O 
O O 

<5 o 

CO 



CD 

? 

O 
to 



as 



9 



o p 



o M 

II 



- oo 

=5= 



CD 



o 
o 

M 

CL 

CO 



o 

CsJ 

o 









CO 


o 

'-4— ' 
CO 

O 


o 


utput 


mean 




E 


o 




s 


i_ 


-1 — I 


o 


o 


o 


inpu 


contr 




18/64 




Calculate characteristic value 



S44 



Create diagnostic support content 



( M ) 



FIG. 21 



19/64 



CO 
< 



CD 



S 




CZ 

o 



a* 
CD 



CD 

CO 
OS 



CD 

E 

OS 



CD 

CO 

Q 



JZZ o 

as 13 

§c 
to 2? 

CD 

-a ar 

CD = 

2 cz 

Q CD 




aS 
o 



2 

CO 

"S 
15 



E 

CD 
CO 

aS 

13 

"as 

"Id 

-4—' 

CO 



o as 

13 



aS 

*> 

CD 



as 

■o 

CD 
Z3 

a5 
> 

CD 

9 

CD 
> 



cz 
o 

-»— ' 

CO 



OS 
O 



CD 
O 

cz 

CD 



o 
o 
O 



aS 
CD 



CD 
Z3 

as 
> 

as 
cz 

Z3 
O 
CQ 



QUO 
CD 

13 



o 

CD 
CD 

CO 



o 



E 

as 

oo 
o 

CO 

in 



aS 

I 

CD 

"aS 

cz 
o 

*co 
CZ 
CD 

E 

TZJ 
1 

CD 



E 

as 
O 

CO 

"as 
cz 
o 

"co 
CZ 
CD 

E 

I 

O 

5 



CD <_ 

O CO 

O =o 



.cz> 



QO 

CO 

X . 
CD 

=a3 
O 



± 



cz 
o 
O 



name 




CO 

"co 

o 

1 








Id 

DO 




Tat 





o 




ll— » 

CO 




Working character 
value calculation 
technique 





identification/ 
:ion technique 




Working 
classifical 





CZ 

o 



o 
o 



OS 

cz 



OS 
X 
CD 

"CD 
CO 



o 

13 

E 
^_ 
o 

_cz 

-£ 

CD 



Z3 



CD 



8 

CZ 
CD 

CD 

Id 



CD 
CO 



CO 
< 



CO 

cz> 



o 

CD 

CD 
CO 

CD 

E 

OS 



CO 

o 

I 

Id 

OjO 
c5 



oS 



CD 

o 



o 

-CZ 

E 
p 



oS 
CD 

CD 

B 

as 



as 

E 
o 

CZ 

"o 

o 
o 

CZ 
CD 

5 



> 



o 

Q. 



co 

_aj 

CL 
CD 



< 



cz> 



LO *~ 

2 < 



CO 

cz> 



cz> 



o 
13 

Z3 

o 
as 
o 

8 g 

"a$-2 
> o 

a> 

y .o- 



o 

13 

o 

CO 

as 
> 



aS 
o 
"QO 
O 
o 

-CZ 

CL CD 

£ §? 
-I 

aS 

O al 



CD 

% 

o 
o 

CZ 

o 
> 



as 
o 

co ,o 
aS -*— » 
T5 c> 
\ -22 
CZ CD 
o °° 

"13 ^ 
£ § 

CD O 



O 

*t5 



OS 
CD 
CZ 



o 

'Id 



o 

co 



CD 
"O 

o 

■ks 

o y 

CD § 
CO ^ 



CD 



co 



CD 

*co 



I 

CZ 

Z3 
CD 



20/64 



Examination condition setting 



Modality 



Endoscope 



y 



A120 



Examination 
region 



Stomach 



M 



Cancel 



OK 



FIG. 23 



A125 

1_ 

Text information input 



II a type early stomach cancer \J 



Important 
findings 



Treatment 
instruction 



Erythematous and surface roughness are recognized. 
Differentiation from adenocarcinoma is important. 
Check pit pattern with magnifying endoscope. 



Use EMR for size of 20mm or less. Adaptive dilation 
up to 30mm is reported. Check it by biopsy. 



Input other information 



Cancel 



OK 



F I G. 24 



21/64 



Reference image determination 




A130 




Ha type early stomach cancer 



A132- 



Confirm/check information 



Cancel 



OK 



F I G. 25 



Call diagnostic support content selection 




Esophageal tumor lesion diagnosis 



Depressed stomach lesion 
identification/classification 



Large intestine information 
remission diagnosis 



Large intestine pit pattern diagnosis 
identification/classification 



Cancel 



A 




Confirm 



F I G. 26 



22/64 



Diagnostic support main menu 



A201 
A202 



Execute diagnostic support 



Update/add diagnostic support content 



End 




-A200 



A203 



FIG. 27 



Test condition setting 



Modality Endoscope 

Test region [ Upper gastrointestinal tract (stomach/gullet)"^ 



-A210 
A211 

-A212 



Cancel 



OK 



-A213 



F I G. 28 



23/64 



Diagnostic support content setting 



Select diagnostic support content 
Modality : endoscope 

Examination region : Upper gastrointestinal tract (stomach/ gullet) 



-A220 



A222 


V 


Helicobacter pylori infection/gastritis diagnosis 


A 




V 


Depressed lesion identification/classification 






V 


Protruded lesion identification/classification 








Similar/typical case reference 


V 



•A221 



Cancel 



Start test 



-A223 



F I G. 29 



Terminal authentication information setting 



Facility name 



Prefectural university hospital 



Terminal name 



First internal medicine endoscope 



ID 



111806 



Password 



5|C #jc j|c 5|C jjc 



Cancel 



OK 



F I G. 30 



24/64 



( Step $21 ) 



Execution of diagnostic support 



,S51 



Set diagnostic support 
content condition 



S52 



Set diagnostic support 
conten t 

\ 



S53 



Load diagnostic support 
conte nt 

\ 

( To step S22 ) 



Updating of diagnostic support content 

\ 



S54 



Select diagnostic support 
content server 



S55 



Transmit terminal specifying 
information 



, .^S56 
Has^C^ 

^communication 
with server been 
established ? 



NO 



S62 



Error 



Refer to diagnostic support 
content management information 



S58 



Select updated/added diagnostic 
support content 



S59 



Receive diagnostic support 
content 



,S60 



Update diagnostic support 
content management information 



Store diagnostic support content | 



S61 



J 

(Return to step S2p 



FIG. 31 



25/64 




26/64 



Diagnostic support content server selection 



Select diagnostic support content server 
Modality 



All modalities 



A261 



Examination 
region 



Upper gastrointestinal tract (stomach/gullet) 



V~A262 



A260 



A264 


V 


Server 1 


A 




V 


Server 2 






V 


Server 3 








Server 4 


V 



A263 



Cancel 



OK 



-A265 



FIG. 33 



27/64 



Diagnostic support content creation main menu 



A271 
A272- 



Create new content 



-A270 



Use existing content 



End 



A273 



F I G. 34 



28/64 



CO 
CD 

1o 

Q. 



CO 
CD 

CD 
CD 



CD 
CD 



CD 

CO 
CO 
CD 



CD 
1o 
Q. 



CD 



O 
O 

±1 

o 

Q. 
CX 
13 
CO 

O 

CO 

o 

I 



CO 
CD 
^_ 

O 



CO 

Q 



as 

-4— » 

CO 



CD 

E 

OS 



go 

CD 



CO 

■o 
o 



CD 



-£± 

" CD- 
GO 

O 



co 



cd 
cd 

CSJ 



CD 
CNJ 

CD 



ex 



_ CO 

O i£Z 
"co "co 
CD to 

CO 

"O O 

CD ^ 
CO CZ 

CD <-> 

o| 
■S 



o 

£ 
o 

CO 



CD 
Q- 
O 

o 



CD 
CD c 

CD 

= X3 
o <u> 

^ E 

CO 

o cu 

^ E 

CD CD 



LO 
CO 



CD 
CD 
CNJ 



CD 
> 



s 



CO 

"co 
O 

I 



I 

O. 



CD 

pD : 



CD 



CO 

CD 



CD 
CD- 
CO 
O 
co 
O 



CO 

o 

CD 

£t: 

CD 

O ° 

GO 

< 



LO 
CO 



CD 
CD 
CNJ 



LO 
CO 



CD 
Q. 



co 

<D <0 

£ 

O 

E o 

=3 

CO 



O 
CO 



O 
CO 



d 

Z3 



CNJ 
CM 



oo 

"5! 



O 



CD 
O 

o 



LO 

CO 

o 



CD 
OO 



cO 

-*— » 
o 

CD 
CD 
CO 



29/64 



.Si? 



o c 5P 

"fee ~ r- 

- IS £ S 



3 & 

CO 



LO 



CO 
LO 
44r 



.5 w o c « 

Q {2 



Is 

+^ p 

CL C 
-E O 

o 



LO ^ 
LO 



CO 

C -4—' 

OS c 

S F c 



CO 



o 



CO 

CD .Q 

co O O 
O O *?= 



8 



CO ^ 
LO 



IS 

o o 

-4-» — * 
CO -fc£ 

o 2 



LO 
3*' 



i c .g 

Z3 O O 
CO --^ o> 
cd °° 

CD 

j2 o 



CO 

O 



3? 



LO 



CL 



E 

g 

o 



A 



V 



CO 
4*: 



cd 
o 

c o 

CD ; j=i 

5 I 



cd 

E 



CD 

O 
to 



CO 
CO 



CD 



co O 

o o 



sr 



CO 

c= 

CX CD 
• £ SP 

13 to 
"cD C 



CD 



o 
o 

M 

CL 
CO 



CO 
CO 

c3 







CO 


o 

*-4— » 
CO 

o 


11 


mean 








1 


1.1 


contra 




30/64 



C Start ) 

v 

Load update/add inquiry 
information 



S71 



Display error 
information 



S81 




Wait for inquiry | 





S73 



Select diagnostic support content 
server 



I 



,S74 



Transmit terminal specifying 
information 



- ^S75 

Has 

communication 
with server been 
^established ? 

,YES 



Refer to diagnostic support "~~\ 
content management information | 



S77 



Select updated/added diagnostic 
support conten t 



S78 



Receive diagnostic support content | 
I 379 



Update diagnostic support content 
management information 



S80 



Store diagnostic support content [ 



F 1 G. 37 



31/64 



Inquiry timing : startup, end of examination, two-hour intervals, 15:00 



-A291 



Diagnostic support content server ID 

001 A 

001 A 

002B 

003C 

003C 



Diagnostic support content ID 
12345 
23456 
ALL 
22422 
33333 



-A290 



F I G. 38 



A292 



#123 



Storage means 
management 
section 



Image 
information 
holding means 

151 



#127 



Diagnostic support content creating section 



Item selecting section 



156 



Classified data set 
creating section 



Graph information 
creating section 



152 



F I G. 39 



-153 



155 



Statistical 
processing section 



154 



Graph creating 
section 



32/64 



O 
-+-» 

1 

"go 

% 

O 

E 
cd 



T3 

CD 

"oo 

o 
E 

CD 



O 

"oo 
o 

O 
CD 

o 



CD 

E 

cd 
cz 

CO 
CO 

o 



1° 

E o 



o 

2 §3 .2 



o 75 

CD .== 

E 

CD cz 

00 cz 
id cd 



E 
a> 



- 15 

§?§ 

o 

o 

CD '-+5 CD 
cd CZ 

e£ | 

C CO C 

cS £ 

O _fD 



E o 

CD 

.-*=: cd 

a, £ 

J o 

> ■— 

13 2, 

= 1 

I E 

c a> 



& «= 

o o 

00 

° o 



52 
*oo 

CD 



.£2 ^ CD 

* i " 
E a> 

X ft? S 
H~ 

O O 
CD 

c OO c 

O ^ O 

its E 

O = O ' 
*4 — Z3 *+— 

.c 00 .c 

CD CD 

^ O 
aS cd aS 

> E > 

e| e 

CD CD . 



CD 

-4-« 
O 

cd 
-CZ 
O 



CD 
CO 



aS 



as 



CD 

Q. 
CD 

-O 

E 

CD 



as _ o 
poo 

~ £ CD 

(n C C 

C CD O 

cz ' » 

cd . 

CZ OA 

£ E o 



CD 
























aS 

a3 
-CZ 






bsent) 


o 












oS 


CO 




o 


-£ 






"Id 


presei 


1 




olor 






o 




as 




CO 


E 










o 




cf 








o 




rmatior 




*-4-» 


Q. 

CD 




«+- 
CD 
-Q 




o 






-Q 


e inf 


terns 


ne (r 


mem 


Z3 


o 


CO 

Z3 


OS 




-*-» 


> 


OO 


^_ 


O 




c 


o 


o 


E 


stri 


o 


Z3 


.23 


O 





cd 
o 

CD 

E 
rs 
cr 

■s 

CO 

as 
cd 



CO 

as 

CD 
-t— » 
CI 

CD 

Id 
"O 

to 
CD 



O 

SB 

O 



r— 

« EE 

_fD _0 



cd 

CD 
=3 



OQ 
CD 

O 



Of 



CO 

E 

CD 



Q_ 

O 



CO 

i_ 

CD 

"CD 

E 

cd 

as 
Q- 



CO 

E 

CD 



00 

cz 



o -+5 



o 



"° Cd 

Id 

CD "O 
<^ OO 



CZ -+-» 

E«€ g 

a> o ±j .2 

iB ^ >, E 2f 

-O O ~ C i=: X 



•2 ^ *& ^ „. 5 

a> S-2 B gig 

M « M O C 

E ^ ^ < 



CD " r "& 1 ".2«j" 

cd o o _ o i=i cd 
C -H Ofl r r c £ 

6:^,3 5 000000 



E 
o 

CD .C 

« S 
.23 o 

— 2 

cd as 

|o 

Z3 



jd 

Z3 
Q 

cd 
o 

CO 
CD 
ZD 

1 

O 



CO CD CD 
■— CO 



CD 

£ 

"cd 
o 

CD 

E 



'Zl oo 



•Hal < 

OO 



cz 
o 

o E 

cd o 

E!£ 

«S -S .52 .52 



_ cd 

§ i 

£ .£ 

O CD 
CD 

O 

CZ 

11 

E x 
cd cd 



cd 



cd cd 
o o 



Jtz •*-' 

3 O co co 



o 

CD 
O 



< 

cj 



33/64 



cd 
CD 



_CD^ 
OS 

^E 

En 



O 



cd 

5 



cd 
"cd 

e 

o 
o 



cd 



t-8 



3 

CO 



CD 



o 



o> cd 

d) g qj d 

«s c 75 E 
E ^ E ^ 

>^ >, CD CD 



O O =^ — _ _ 
Q- Q- ZD ID I I 



CD 

cd 
^E 

cd 



Q. 

E 
>> 



CD 
Cd 

E 

CD 
Cd 

E 
o 

Q. 

E 



c: 
o 
"co 
o 



CD 



CD 



o 

'co 
O 













^ CO 


CD 






O 












cd 













CD 




-»— » 




ZJ 




O 




CD 




Ex 





1« 



OJ 



CO 



CD , 



CD 



Cd 
CL. 



CD 

>: 



CD S 

la 



co ^d" 

CD CD 

=3 =3 

O O 

*-*-» *-•-» 

CO CO 

CD CD 

cd cd 

O 6 O 



CVI 

CD 
=3 

O 
*-*-» 
co 

CD 

I 



-§ CD g 

cd _2 * — 
Q cd 
> 



cd 



s CD V 
ooS co 



cd 



s gi.o 

CO 



CX0(s"O 



E 

CD 



cd 



I 

o 



Q. 

tlD Q. 
CD O 

IS 

IS 



CD 



3 
o 



* — CNi co ^d" 

CD CD CD CD 

Z3 Z3 =3 Z3 

Cd Cd Cd Cd 

o o o o 

rt> "-4— » "-4— ' "-4— » I|— » 

g^. CO CO CO CO 

™ <D <D 1) (D 

o o o o 

cd cd cd cd 

a> k_ *_ 

*.# » cd cd cd cd 

cd -c sz -£Z 

Q- O O O O 



-2 CD 
cd _3 
Q cd 



cz 
o 

Id 

"co 
o 



o 

CD 
Id 



CO 



ha 



GO, 



c: 

h CD 



co 



oo 

LO 



cd _ 
.$=2 E 

H— CD 

co jfcf 

O 



rv. V 

sr 
o 



bed 
> 

CDnJ 



k CDs 



jd N 



CD 

O ^ 

cd ^ 

II > 

i i-g «~ 

CO -Si S X 



o?5 
CD 



O 



CD g 

E 

t: o d 

O ■*-» CD 

CO 



CO 
CO 



34/64 



Processing^ 




Others ls selection 

operation area determined 
as 1 ? 



Classification 
item selection 
area 



Update display list 
of classified data set 

I 



( To A )(~ToA) 



Two- 
dimensional 
scatter 
diagram 

^TA-8 



Case count 
bar graph v 



Validate data value 
1 selection area and 
data value 2 
selec tion area 

I 

( To A ) 



Invalidate data value 1 
selection area and data 
value 2 selection area 



\ 

( To A ) 



.TA-11 



Validate data value 1 
selection area and invalidate 
data value 2 selection area 



F I G. 42 



( To A ) 



35/64 



Execute classification 
information setting A 



Is 



image information 
acquired ? 



All pieces of image 
IB L information have been 
acquired 



Acquisition of image 
information has 
succeeded 




TB-4 



Register image information 
in corresponding classified 
data set 



F I G. 43 



36/64 



Necessary 




Unnecessary 



Statistical test 



Execute statistical 
processing D 



TC-4 



Execute statistical 
processing E 



✓TC-5 



Create one graph by grouping 
pieces of image information of 
classified data sets 



Is 



✓TC-6 



superimposition 
information creation 
.necessary ?. 

Unnecessary 

y 

End of C ^ 



Necessary 



/TC-7 



Render superimposition 
information on graph 



( End of C ) 



F 



IG.44 



37/64 



Cp 

y -TD-1 



Calculate statistic 




Calculate statistic 



t ^T E-3 

Execute test 
p<0.001 
P<0.01 
p<0.05 



Q End of E 



F I G. 46 



38/64 



Characteristic value 1 



O 

-8- 



..X. 

x 



Adenocarcinoma/ Stomach cancer/ 
female female 



F I G. 47 



Frequency 





s 
\ 






\ 
\ 
s 






\ 






\ 






\ 






\ 




s 


\ 




\ 


\ 




\ 


\ 




s 


s 




\ 






\ 






\ 


s 




\ 


\ 
\ 




$1 







S 








77 


n 

\ 








zz 


\ 
i \ 








S 1 


i \ 








\ 


1 \ 








\ 


1 \ 




rs 




\ ■ 


1 \ 




\ 




V/ 


1 \ 
1 \ 






\ 
s 




V7 


1 \ 
1 \ 

\ 






\ 
s 
\ 






s 






\ 




\ 


\ 






\ 




\ 


\ 






\ 




\ 


\ 






s 




\ 


s 






\ 




\ 








\ 




\ 


s 






\ 




\ 


\ 






\ 




\ 


\ 






\ 




\ 


\ 






\ 




\ 


s 






\ 





Adenocarcinoma/female Characteristic value 1 
PI Stomach cancer/female 



F I G. 48 



39/64 



Average value of 
characteristic value 1 



p<0.001 



p<0.001 



NS 



FIG. 49 



Adenocarcinoma/ 
female 



100% 



Stomach cancer/ 
female 

p<0.001 



Polyp/ 
female 




F I G. 50 



Atrophy degree (-) 

Vs 



HP- 



Atrophy degree (+) 

□ hp+ 



FIG. 51 



Statistical information 




Adenocarcinoma Stomach cancer 


Total 

Patient age 
Characteristic value 1 
Characteristic value 3 


32 22 
50±15 70±5 
0.4±0.05 0.7±0.13 
1.5±0.08 1.7±0.01 



40/64 



\ JD 
s oS 

^ E 

\ oS 
O x O 



N 5 



8^ 

o 



a> 
"a 



o 

CO 



CD 
O 



On 



CD 



E 



CD 

CD 

as E 

CD E 4=- CD 
aS 



c ^ E ^ E E 



CD 



a a i- C _ 

>^ >% CD CD c cz 55 

a_ a_ ZD _lf J_T lu 



CD 
aS 



CD 



CO 

O 



CD 
O 

cz 
as 
O 



iI3 CO 



CD 

O 
CD 
X 



-S3 as 



CD 



CD 



aS 



CD 

> 



cvj 

CD 
Z3 

as 
> 

CO 

CD 
-»— » 

as 



CO -xj" 

CD CD 

o o 

"-4— » *-4-» 

CO CO 

CD CD 

as as 

aS aS 



* — OJ co \T 

CD CD CD CD 

=3 Z3 Z3 Z3 

£ £ £ £ 

.o o o o 

§n .^2 .S5 .<2 .^2 

CV* CD CD CD CD 

-fci « 1j 

5 2 2 2 2 

*-t j as aS aS aS 
as -C= 

Q_ O O O O 



J3 CD 
as _3 
Q aS 



43 cd 
as _2 
Q as 
> 



Cvj 

O 



o 

"13 



as 

CD 



Q. 

2 



aS 



* v_ 
^ CD 

aS 

"aS 
c 
o 

CO 

cz- 

CD 



aS 



o 

CO 



2 
I 

S 2 

"as "° 



Q. 



CD 

aS 



o 

CO 

s > 

E CD 



Z3 
O 

o 

CD 
CO 

aS 
O 



CD 



CL 

as 
^- 




as ^_ 
E 

Mz= CD 

O 



13 



as 



CD 



2 



as 



CD > 

^ "to 

Jrt CD cd 



CO 
CD 



"8 



CO 

OS _q Q. 



O 

o 



as 
o 

J 
o 



o 
o 

aj 



O "5Z 



CL 

as 
OO 
aS 

CO 

CD 

13 

CD 

o 



CD 
Q. 



41/64 



Necessary 




Unnecessary 



TC-2 

Statistical Statistical test 

processing type 

Statistic -r, 



Execute D 



TC-4 



Execute E 



TC-8 




/TC-5 



Create graph by grouping pieces 
of image information of classified 
data sets 



TC-9 



Create graph for each 
classified data set 



,TC-6 



Is superimposition 
information creation 
.riecessary?,. 

Unnecessary 



End of C ) 



Necessary 



,TC-7 



Render superimposition 
information on graph 



( End of C ) 



FIG. 53 



42/64 



Characteristic 
value 1 



Characteristic 
value 1 



_o__ 
o 



8 



X 



Adenocarcinoma/female 



F I G. 54A 



Stomach cancer/female 



F I G. 54B 



CD 
Z3 
a* 

> 
o 

CD 
i— 

<d 

O 

*S 

<D 
> 

I 



p<0.001 



r 



Adenocar- 
cinoma/ 
female 



CD 
1 



CD 



O 

CD 
Z3 

IS 
> 

CD 
8? 

I 



NS 



CD 



2 



OS 
x: 
o 

*S 

CD 
Z3 

> 

S 
I 



p<0.001 



Stomach 
cancer/ 
female 



Stomach 
cancer/ 
female 



Polyp/ 
female 



Adenocar- Polyp/ 
cinoma/ female 
female 



F I G. 55A 



F I G. 55B 



F I G. 55C 



43/64 



#123 

I 

Storage means 
management 
section 



Image 
information 
holding means 

" f " 
151 



c± 

Information list 
creating section 



171 



,172 



154 



Graph creating 
section 



Display 
information 
management 

section 



Diagnostic support content creating section 



— r 

#127 



#128 



Input l/F 



F I G. 56 



( Start ) 



TH-1 



Detect selection of graph element, 
image, or list item 



TH-2 



Cancel selected state of graph, 
image, and list 



TH-3 



Acquire image information 
corresponding to selected item 



TH-4 



Acquire graph element, image, and 
list item corresponding to image 
information 



TH-5 



Set graph element, image, or list 
item in selected state 



F I G. 57 



44/64 



Image information list 



173 




Yamasaki 
222 



r i 



Image 
ID 



IE 



Patient 
ID 



222 



333 



444 



Patient 
name 



Yamasaki 



Imaizumi 



Nishimura 



Examination 
date 



2000.01.01 



2000.04.02 



2000.06.05 



F I G. 58 



45/64 



One-dimensional scatter diagram 


v^I lar aLLci loLIU 






value 1 


o 


X 

___x___ 

\ 




-8- 


M76 




— CT~ 


^ 


Adenocarcinoma/ 


Stomach cancer/ 




female 


female 



F I G. 59 



One-dimensional scatter diagram 


Characteristic ' 
value 1 


l 


X 
X 






o 




\ 

M76 




—i U" 






Adenocarcinoma/ Stomach cancer/ 
female female 



F I G. 60 



46/64 



GEO 



/rj-1 



Input item to be changed and item value 



TJ-2 



Detect selection of graph element, image, 
or list item 



,TJ-3 



Acquire image information of selected item 



,TJ-4 



Update data of image information of 
selected item 



✓TJ-5 



Update display information 



c 



End 



FIG. 61 



47/64 



#123 

I 

Storage means 
management 
section 



Image 
information 
holding means 

151 



cL 

Information list 
creating section 



171 



,154 



Graph creating 
section 



172 



Display 
information 
management 

section 



182 



Information updating 
section 



183 



Information setting section 



Item value setting section 



Information support content 
creating section 



181 



#127 



Input l/F 



#128 



FIG. 62 



190 



Selected element information updating 
Selected element region-of-interest setting 



-191 
-192 



F I G. 63 



48/64 



So 



CD 



OO' 



LO 
CD 
CD 



OS 

CD 



OAs 



Q0 N 



. <L>N 

CO 



CD 

CO 



V CO 



CO 



CD 

E 

CD 
CD 

"8 

-4— » 

O 
CD 

CD 
CO 



cz 
o 

E 
o 

DO 



"O 
Q. 



co ^ CD 
co 

° c s £ 

» g E § 

« Jf S % 

O Q LU Q_ 



ft 



CD "O 
_Q CD 
_ CXO 

B § 

CD 



49/64 



Updating of information of selected element 



231 
232 
233 
234 



Patient name 
Examination date 
Examination region 
Occupying region 
Diagnosis name 
-[Fine classification 1] 
-[Fine classification 2] 
-[Fine classification 3] 
-[Fine classification 4] 



Tanaka 



2001.02.10 



Stomach 



Cardia 



Update 



184 

•220 
-221 
-222 
-223 
-224 
-225 
226 
-227 
-228 

-229 



F I G. 65 



231 
232 
233 
234 



Updating of information of selected element 



Patient name 
Examination date 
Examination region 
Occupying region 
Diagnosis name 
-[Fine classification 1] 
-[Fine classification 2] 
-[Fine classification 3] 
-[Fine classification 4] 



Tanaka 



2001.02.10 



Stomach 



Cardia 



Ulcer 
Gastritis 
Polyp 
Erosion 



=F 

230 



V 



V 



V 



184 



-220 
-221 
-222 
-223 
-224 
-225 
-226 
-227 
-228 

Update | — |— 229 



F I G. 66 



50/64 



Examination Occupying Diagnosis Fine classi- Fine classi- 
region lesion name fication 1 fication 2 



Fine classi- 
fication 3 



t Stomach - 



-Colon 
-Gullet 



- Cardia 

Curvature 

ventriculi 

minor 



F I G. 67 



■ Cancer - 



_ Borrman {_ 
classification 

- Type 1 

- Type 2 
-Type 3 

- Type 4 



•Ulcer- 



L 



Temporal 

classification 

- Gastritis -i r- 

L Sydney L 
classification 

L Yamada/ L 
fukutomi 
classification 

Erosion — 



Early 
stomach 
cancer 
macroscopic 
classification 

Type I 
-Type Ha 
-Type II b 
-Type lie 
L Type I 

Forrest classification 



Progression 
degree 

-m 
-sm 
-mp 



Fine 
classi- 
fication 
4 



Polyp- 



Schindler L Macroscopic L EUS 
classification classification classi- 
fication 

WHO classification 



231 
232 
233 
234 



Updating of information of selected element 



Patient name 

Examination date 

Examination region 

Occupying region 

Diagnosis name 
^[Borrman classification] 
-[Macroscopic classification] 
-[Progression degree] 
-[Fine classification 4] 



Tanaka 



2001.02.10 



Stomach 



Cardia 



Cancer 



V 



V 



Update 



-184 

-220 
-221 
-222 
-223 
-224 
-225 
-226 
-227 
-228 

-229 



FIG. 68 



51/64 



#123 

I 

Storage means 
management 

section 
1 



Image 
information 
holding means 

' 1 
151 



c± 

Information list 
creating section 



171 



,172 



,154 



Graph creating 
section 



< — *- 



Display 
information 
management 

section 



182 



Information updating 
section 



201 
_J_ 



Region-of-interest setting section 



Information setting section 



Information support content 
c reating section 

#127 



181 



Input l/F 



#128 



F I G. 69 



52/64 



Determine 
temporary 
position as 
true position 



T1-1 

/ 


Press right 
button of 


T1-2 

? 




Area setting 


mouse 


Moving step 




step 


-< 


Press left button 



Release left 
button of mouse 

Release left 
button of mouse. 



,T1-3 



T1-4 



Size changing 
step 



Position temporarily 
determining step 

Move mouse while 
pressing left 
button of mouse 



F l G. 70 



Image information list 



173 




- 2 



Yamasaki 
222 



Image 
ID 



Patient 
ID 



Patient 
name 



222 



333 



444 



Yamasaki 



Imaizumi 



Nishimura 



Examination 
date 



2000.01.01 



2000.04.02 



2000.06.05 



FIG. 71 



53/64 




F I G. 72C 



54/64 



#123 

I 

Storage means 
management section 



213 

1 



Marker rendering 
section 



#127 

1 



Diagnostic support 
content creating section 



F l G. 73 



1 


r 


Acquire accompanying data | — 






Render marker 




r 



( End ) 

F I G. 74 




Tanaka 
111 
M 

00.05.27 



210 

F I G. 75A 



211 



F I G. 75B 



Tanaka 
111 
M 

ft 



\_ 



y 



212 

F I G. 75C 



55/64 



#123 

) 




220 

) 




221 

? 




#127 

> 


Storage means 




Character 




Character 




Diagnostic support 


management 


— *~ 


information 


— *~ 


information 


— >■ 


content creating 


section 




erasing section 




rendering section 




section 



F I G. 76 



( Start ) 



1 


r 


Erase patient information 




r 


Acquire accompanying data 




f 


Render accompanying data 







C End ) 

FIG. 77 



Characteristic value 1 
0.35 

Characteristic value 2 
1.55 



F I G. 78 



56/64 



#123 
#124- 



Storage means 
management section 



Diagnostic support content 
management section 



— 


Image processing 




—>- 


section 




Diagnostic support content 




creating section 





250 
-#127 



F I G. 79 



Image data 
(R, G, B) 



Conversion table 



Image processing table 
access section 



(R, G, B, m) 



Conversion table 
changing section 



n 



— r 

253 



n 



Converted 
-rvalue n 



252 



-250 



Image processing table 



-251 



F I G. 80 



Image processing table 251 



(0,0,0X0,0,1)- 


1 

•(255,255,254X255,255,255) 


• • 




(0,0,0X0,0,1)- 

• • 


M 

•(255,255,254X255,255,255) 



F I G. 81 



57/64 




Access image processing able 



1 






Hold image processing value 







F I G. 82 



#123 

<> 




260 

<> 




#15 


Storage means 


*- 


Data embedding 
section 




Diagnostic information 


management 


<. 


>• 


input/output 
control means 


section 




-< 



F I G. 83 



58/64 



c 



Start 



3 



TL-1 



Clear data at first bit of pixel value 



TL-2 



Rasterize data into bit data 



TL-3 



Embed data in pixel value 



c 



End 



F I G. 84A 




TM-1 



Acquire data from pixel value 
Create pixel information 



FIG.84B 



59/64 



f 



FIG. 85 { 



V 



(FF.A1.00) 


(FA,A0,01) 




(FA.A1.03) 


(FB,BF,03) 










1 


(FE,AO,00) 


(FA.A0.00) 




(FA,A0,03) 


(FA.BE.02) 










Characteristic value of 60 
-binary number 00111100 

I 


(FE.A0.01) 


(FB.A1.01) 




(FA,A0,03) 


(FA,BF,02) 


1 









(FE,A0,01) 


(FB,A1,01) 




(FA.A0.03) 


(FA.BE.02) 


\ 









F I G. 86 



Binary number 00111100 
♦Characteristic value of 60 



60/64 



2 
3 

4 

5 



Endoscopic device 
Light source | 



] 



Endoscope 



Video processor 



T 



Observation monitor 



/ 



Main program 



Image storage means 



T 



Characteristic value calculation means 



T 



Diagnostic support information 
display means 



F I G. 87 



Characteristic value calculation means 








Blood vessel extraction means 




—101 


1 








Blood vessel characteristic value calculation means 




-102 



F I G. 88 



Blood vessel extraction means 



Preprocessing 
section 



z: 



Blood vessel candidate extracting section 



Edge information detecting section 



Color tone calculating section 



•111 



Density gradient 
calculating section 



I 



Shape edge 
determining section 



Separating section 



•141 



! 



F I G. 89 



61/64 



( Start ) 



S101 



/ Input image data / 



S102 



Start calculating 
characteristic value 



S103 



Perform preprocessing 



,S104 



Calculate 
color tone 



SI 05 



Detect edge information 



S108 



Extract blood vessel 
candidate 



,S109 



Separate shape edge 



,S110 



Calculate blood vessel 
characteristic value 



sin 



End characteristic value 
calculation 



S112 



Display diagnostic support 
information 



( End ) 



1 



S106 



Calculate density 
gradient information 



S107 



Determine shape 
edge 



T 



F I G. 90 



62/64 



111 



Preprocessing section 



Inverse gamma correction processing section 



Noise suppressing section 
t 



Color misregistration correcting section 



-112 
-113 
-114 



FIG. 91 



Store pixel PV that satisfies condition 
"V2 G(x,y)£ threshold TV" 



Calculate minimum value Cmin of 
color tone data C at pixel PV 



Binarize color tone data C with 

minimum value Cmin 

(blood vessel candidate data BiC) 



•S220 



S221 



-S222 



F I G. 92 



0 


1 


0 


1 


-4 


1 


0 


1 


0 



F I G. 93 



63/64 



Calculate linear sum Grad C of Grad 
R,G, B 



Binarize Grad C with predetermined 
threshold TGrad (shape edge data BiGrad) 



F I G. 94 



Calculate logical product L of BiGrad 
and BiC 



Perform expansion processing of logical 
product L based on BiC 



Remove expansion processing result 
Exp from BiC 



F l G. 95 



64/64 



r 



Blood vessel portion Shape edge portion 



FIG. 96 < 



v. 



GradG 
V2 G 

RAR+G+B) 
BiC 




Blood vessel portion Shape edge portion 



FIG. 97 1 



G 

GradC 
BiGrad 



----- TGrad 



SL 



FIG. 98 < 



Blood vessel portion Shape edge portion 



BiC 



BiGrad 




Logical 
product L 



